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ABSTRACT 

This study surveyed student and faculty opinion about 
the university grading system. The results shov discontent with the 
system, but a feeling that some type of grading is probably 
necessary, students disagreed that faculty collect enough information 
for grading; students did not believe faculty were too lenient in 
grading, but many faculty disagreed vith this point; both faculty and 
students agreed that course objectives were too obscure, but students 
did understand what they must do to get a grade. Students had a 
tendency to believe that grades are related to faculty ability, but 
faculty disagreed with this. Students and faculty alike were split in 
preference for objective and subjective grading, but AI»s preferred 
objective. All groups agreed that faculty should be allowed to choose 
different products (papers, tests, etc.) as a base for grading 
different students. Students ard faculty saw grades as activating 
(males more than females) , and as anxiety producing (females more so 
than males). All believed that good grades are useful in getting jobs 
and in being accepted for graduate work, but students believed grades 
do not accurately reflect their achievement. Faculty had a tendency 
to believe grades do reflect achievement, but AI's were undecided. 
All groups lean toward agreeing that some form of grading is 
necessary if academic standards are to be maintained. (Author) 
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INTRODUCTION 

One of the perennial controversies among students 
and faculty alike centers on the grading system of the 
Univer-ity. Typically the discussions are based on very 
little data. For this reason the Bureau undertook to 
provide information which could bring an element of 
objectivity into an arena where emotions typically hold 
a strong upper hand. 

The intent of this study was to survey a carefully 
selected sample of faculty, associate instructors, and 
students to see how they view a variety of situations 
related to the grading system. The system here is the 
classical, four-point scale of A, B, C, D, F f with F 
being failure, and A being superior work. Typically C 
is considered average achievement although there is clear 
evidence that the average grade runs well above C* 

The following pages report student data separate 
from faculty, and then provide a brief comparison. 



*Chase, C. I., Thompson, R . , Predicting Success for 
University Freshmen, " Indiana Studies in Prediction : 
No. 1, Supplement Bureau of Educational Studies and 
Testing, Indiana University, Bloomington, Indiana, 1973 . 



9 

ERLC 



i 



THE STUDENT DATA 

01 the 195 questionnaires completed by students , 
190 were usable for analysis. of this sample , 95 were 
responses from females and 95 from inales. Sorting by 
class yielded ^3 freshmen (22 percent), 43 sophomores 
(22 percent), 30 juniors (15 percent), 38 seniors (19 
percent), and 36 graduate students or "other" classifi- 
cation (18 percent)* A balanced sample of students was 
obtained. 

Five graduate student interviewers were used to 
obtain the student sample. The interviewers were 
instructed to administer the questionnaires to students 
in a variety of locations, uuch as dorms, cafeterias, 
libraries, sorority ond fraternity houses. This was 
done to insure a sample as representative of the spectrum 
of students as possible. 

The interviewers gave instructions regarding the 
questionnaire and received the completed instruments 
from the student respondent . 

Responses to the Student Questionnaire 

The design of the questionnaire allowed five cate- 
gories of responses, from strongly disagree tc< strongly 



3 



agree, for 26 of the items. The 27th item requested a 
ranking of preference for various procedures for deter- 
mining grades. The student questionnaire, together with 
percentages of students choosing each category of 
response, is shown in Table A. 

Student opinion was generally spread across response 
categories, which indicates that student feelings were 
not unanimous regarding grades or the grading system. 
However, it appears that over half of the students were 
dissatisfied with some aspect or aspects of the grading 
system. (In tb rt discussion which follows, the "agree 11 
and ,f strongly agree" percentages are usually combined, as 
are the "disagree" and "strongly disagree" percentages; 
the percentages for separate categories can be found in 
Table A.) 

Sixty- three percent of the students agreed or 
strongly agreed with Item 1, which states that the pre- 
sent grading system is inadequate. Nevertheless, about 
the same proportion agreed that some form of gracing is 
necessary to uphold academic standards (Item 16) good 
grades help students in the job market (Item 25) and in 
getting into graduate work (Item 26). Students appear 
to believe that grades have a clear role, but do not 
like the system. 
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Fairness » Various aspects of the grading system 
were treated in the questionnaire. One significant 
aspect might be termed fl fairness"~whether or not grades 
received correspond to student achievement or performance. 
Statements dealing with this question are numbers 2, 3, 
5, 6, 7, 12 , and 22. Twenty-six percent of students 
sampled strongly disagreed, and 39 percent disagreed with 
the statement: "On the whole, my grades accurately repre- 
sent my achievement at I.U." <Item 2). Similarly, about 
two thirds of students disagreed in some measure that 
faculty acquire enough evidence to report valid grades 
(3), although slightly over half believed that most 
faculty are confident about their ability to evaluate 
students* work (7). 

Most students disagreed with statements that faculty 
are lenient in awarding grades Citem 5) or that few 
faculty will award D f s or F*s even to low achieving 
students (6). Only 20 percent agreed* and 60 percent 
disagreed* that the grading system differentiates fairly 
among students who achieve at different levels (12) • A 
high proportion (8^ percent) of students reported that 
instructors of different sections of the same course are 
likely to give different grades for the same level of 
student achievement (22). 

ERLC 



Related to the question of fairness is the degree 
to which students believe they are informed about objec- 
tives of a course and the basis for grading. Only twenty- 
eight percent agreed, while 59 percent disagreed t that 
most faculty make it clear to students precisely what 
they are to learn in a course <*0. However, 71 percent 
responded that they do usually understand the basis on 
which their grades are given (8). 

Variables in jgrade achievement , I* , in the opinion 
of many students, grades do not correspond to achievement 
or performance, what might be the sources of grades? 
Seventy-one percent agreed (30 percent strongly agreed) 
that to get a good grade it is often necessary to agree 
with the instructor's opinions (18). Half of the students 
reported that their grades usually correspond with the 
instructor 1 ^ teaching ability, although 32 percent dis- 
agreed (19). "Grades depend heavily on how effectively 
a student studies 11 drew agreement from 51 percent of 
students sampled, but 37 percent disagreed (20). Opinion 
was diverse on whether grades correspond more accurately 
with achievement in a student's major than in other 
course areas (Item 21). Forty-one percent of the students 
agreed, 3 3 percent disagreed , and 27 percent were uncer- 
tain that grades were more accurate in major subjects 
than in other courses. 
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Instructing options . Utatementt; 'J and 10 dealt with 
instructor options lor grading procedures. Fifty-one 
percent of the students agreed that instructors should 
be allowed to select a different basis f juch as tests, 
papers, project* 9 etc., for grading one student than is 
used for another student; 34 percent disagreed. Students 
were l^c^z willing to allow options regarding standards; 
L>6 percent believed that instructors should use the same 
standards of quality for grading all students » while 
3 3 percent disagreed. Kegarding their own preferences 
for bases of grades (Item 17), students were split between 
objective and subjective procedures. Thirty-six percent 
preferred objective (test based) to subjective grading 
procedures, 3 3 percent did not, and 29 percent were 
uncertain. 

Effects of grades * Some possible effects that 
grades and the grading system may have on students were 
the subject of statements 11, 13, 14, 15, 23 and 24. 
Lighty-tive percent of students agreed, and only seven 
percent disagreed, that an instructor^ reputation for 
strict or easy grading influences a student f s selection 
of a course Competition r imonR students (13) is 

tied to the grading system, as is anxiety over anticipated 
grades (14), according to a majority of students. In 
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addition, although 3<* percent thought they would study 
less in courses if grades didn't exist, b 1 * percent dis- 
agreed with that statement (15). Students disagree 
(78 percent) that students with a reputation of high 
GPA's are less likely to be accepted by their peers- 
nearly as many (73 percent) reported that a student 9 j 
vVtV\ affoctj the way a student sees himself. 

Although most students seem to believe that there 
are several negative (and a few positive) effects of the 
grading system, they also perceive some uses for grades. 
Almost two thirds agreed that some form of grading is 
necessary to uphold academic standards (Item 16). About 
the same proportion agreed that better jobs are offered 
to students with high GPA's (25). That grades are useful 
for selection of students for graduate school (26) was 
acknowledged by percent of the students; one fourth 
disagreed. 

The preference for grading procedures was the sub- 
;ect of Question ?7. Forty percent of students ranked 
"combination of above" as their first choice, and the 
others in order of preference were "objective tests," 
"essay tests," and finally "term papers." 

In summary, it can be concluded that students view 
the grading system as inadequate, but believe it has some 
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uses which may justify it. However, about two thirds 
of students feel that grades are not administered in a 
uniformly fair way, and that effects of grades on stu- 
dents are largely undesirable. 

SEX AND CLASS DIFFERENCES 

Do male students hold opinions on these questions 
that differ from those of female students? Do upperclass- 
men or graduate students view grades and grading proce- 
dures differently from undergraduates? To determine if 
the sex or grade level of students was related to their 
opinions about grading, separate analyses were run on 
those subdivisions. 

Percentages in response categories for male and 
female students for each item are in Table B, and 
Figure Bl shows the location of the mean rating of each 
group. 

On the grading issues treated in this questionnaire, 
opinions of male and female students were quite similar, 
although female attitudes may have b^en slightly more 
negative. (See Table B and Figure Bl.) More males than 
females disagreed that the system was inadequate and 
agreed that some form of grading is necessary to uphold 
academic standards. Competition was important to more 
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males, while more females were concerned with anxiety, 
itore females disagreed that they would study less if 
grades did not exist , and more males felt that grades 
depend heavily on how effectively a student studies. 
Instructor options regarding grade bases and standards 
were reviewed favorably by more females* Considerably 
more males than females believed better jobs are offered 
to students with high GPA f s. 

Table C shows percentages in response categories 
for each class and graduate students. Although there are 
differences in opinion across classes f there are no con- 
sistent trends or relationships between class and atti- 
tude * except for an increasing preference for term papers 
and decreasing preferences for objective tests, as grad- 
ing procedures, with higher class levels # Means for the 
four classes and graduate students are reported and 
illustrated in Table D. 



9 

ERLC 



10 



o 

h4 

i^t a; 
to s: 
** * ^ 
o O 

Urn 

< en 

ao o 

< o z> 



-4 *J 

< 

u 

(J? (X 

<C 

Am 

w 
u 

W 



s 

4) 



r\» en 



rr 

TJ 



I 

Q 
I 

U 
I 

GO 
I 

< 



in 

c 

TJ 



C 
0> 
to 
01 

a. 

<u 

.c 

H 



> 

o 
>* 



uj 
a 



u 
u 

£0 
0» 
TJ 

>> 

& 



« # 

0)3 
X5 ♦ 
*-» M 

C -H 
o <« 



CM 



a* 
o 
c 

<D 
4»* 

at 
a* 

e • 

O 0) 

6 o 

O 0> 

tj 
a» «s 
u u 
c to 

T? TJ 
> «H 

x; 

O 

C U 

V o 
a 
u at 
u u 

* o 

u 

0) 

4-> (A 

■38 

u a> 
a) </i 

v 

ns bo 

© o 



o> 



,C 
It 

«— i 

a> 
to 

o 

01 

a. 



c 
a> 
t? 

W 

o 



0* 0) 



<M O 



U3 



0> 
T5 

vii) 
T3 



5 



4^ 
C 

c 



o 

o 



It 

s 

GO 
0) 



3 

Cm 



tvfl 
C 

> 

0? 

o 

C 



> 



V 4-* 

<n c 

V4 



> 



o 



c 

G 
O 

NO 

*■» 5 

a in 
«m C 
TJ 
j +■* 



kg} r-f 



C 

0) 

0) 

a) 

Im 

bo 

& 

o 

^: 
Si 

c 
o 



(9 



0) 

C 
3 



3 



3 



* C 

o 0> 

a> 3 

* w 

a* O 
§ 

w 

+-» Li 

(0 O 
Im 

TJ 
- « 

*r4 10 



w x: 

in X) 



C 

G 0> <M 
ft) <M CO 
> <M 
H'H 0) 

60*0 c 
bO 

CP c 
a) TJ 

0) (4 

(0 tab 



04 



b0 
C 
*H 

TJ 
01 10 

a> a ■ 
x: <h w 

0) (0 0> 

^ © sr 

TJ Hi OT 
O * V 

jC box: 

CO * 4-» 
0) O 
fi4^ 

o bO 

4-» *-» C 
TJ «0 



(0 (4 

C A* 

x: <m 
a xj 

0) 

(0 >Jto 

10 4J 

a 



0> 



9 

C olw 
0) fl) 
> <H 
♦H O 4>* 
b0 C 
CO 0 
TJ TJ 

•H TJ tO 

5 § 0) 
^« f> C 
J to O 



9 

ERLC 



11 



% 

c 



6 

o 











<n 




en 




00 


u3 


in 




3" 


r*4 


<n 






O 


cn 


o> 




CM 








cm 


UD 


m 










r-4 


(11 




IN 




r-4 




i*1 






• 














00 






•H 










0 






00 








c 


8 


00 


0i 


•H * 








T* 0> 










r-4 




m 




u 




M 


HO D 


<n-4 


u 


CL> 


O 






T 1 


>» o 








(0 






m 








c 


o> 


& 




o 




4^ * 






^ o 


(tt to 


>» 




o 


*r-+ <— < 












M 




n > 


TJ 






OA 


0» 


CI 


•H ^ 




4-* 


01 


£t u 




<tJ 




<y 




0) 




to <~* 


<*< c 


S* 


ra 


a> 




CJ 


o 


f-» to 


tj fr» 






o 




t/1 




U_, ;/} 




•H 


l-l 




r-4 






C 4-* 




tn 


t. 


D C 


*5 T? 




?3 








u 


4-* 


(J/ 4-* 








C TJ 




to 


4»* 








3 Ul 




4-» 


•o 


Cu 


> 


10 












U 










,c 


c 




0 


tfl U 


o 

§ 








o 










o u 


O 




c 


«-> c 


tf),C 




D 




C 5 


o 










*-» 




n ti> 




m • 


♦J <M 






^ >. 




£- C 














•r4 


T? 


u 






CP 3 


6 


♦J X 


q c 

< 0 


x: 4-» 







O 



c 



in 
4) 

O 

u 
c 

10 
(0 

a; 



-A 
TJ 

o 
p. 

X 



0» 

r-* 

O 

o 

is 

<0 

a> 
c 



t>0 

c 

o 

O I 



CD 
CM 



GO 

c 

00 

> 



u 

O 



t3 

10 



to 



> 

U 
0) 
•n 

o 



« CM 
CM i-4 



to 

u u 
a. o 
u 



it 

CM 



co in 



CM 

f-4 fM 



i-4 fM 







9 






in 










O 


•H 






T? 




>, 


3 






4-> 






Uj 










•H 


4-» 




X> 


c 


t4 


«T5 


at 


00 




TJ 




00 






C 


^» 


o 


»r4 


10 


4-» 


x: 






u 


f9 










a» 


>k 


§ 


4-* 












a» 


> 


O 


x: 




cx 


4-* 


4-» 


6 








^: 


V 




4-» 


^. 


c 




IH 


a> 




0> 














0 


c 


0 




0 


xz 


to w 


p< 




•H C 


(0 


c 


Q 


2 


0 


^ »H 






C 






•H 


O 


f-4 


ot a. 


U 




T? O 




> 












0> 




f-4 • 


x: 


u 


m u 




T3 O 




T3 




W V 


c 


8 0 


3 U 


a; 


00 2 




a 




to 


a> 




© v 


TJ 


to 








«TJ C 


(0 




t*»r4 


at 


00 


00 


T3 




at 




0 X 








51 4-» 


•J 


CD 


CTt 


O 



c 



4H 
C 



> 



Dp 



CM 



40 



r4 



CO CM 

cm cn 



to 

T? ^ 
C O 

8.° 

(0 fc. 

o o 
y c 

>s»H 



a u 

v o 

a> 6 
C 

o to 
a- 

to c 

T3 TJ 
3 

tf> to 



CO 



CM 

cn 









r-4 






0» 4-» 






^ c 




0> 








r-ITJ 




•H 






r-4 


0> 4-* 










CO 






to 






0» 


V O 




i-4 


(0 










01 


3 0) 




!3 


0 > 






0 0> 










to 


»a 






o> 






O 




> 


U3 






to 




(30 


C 0) 






Q JZ 






•ri 4-» 






♦J 










0 


o> 0 




# 


(0«H 




c to 
0 u 


V CO 




•h a» 


c at 




4-» 0» 

a 


V T5 








4-» 


0) fci 






<M 00 












4-» 












0» 






C 






•H V 








• 




tfl <M 


4-» 


•r4 TJ 


^•«-» 


c 


& 0) 


O TJ 




4-» 


4-» 




(0 p. 


O 0) 


a> 


4-» 0) 


3 > > 


c a 


U-H 


0) 


ai a 


4J 00*H 


T? ftJ 


to 


.c 




c 0 


u 


4-» 12 


M 4-* 


of 


C/J Q 



CM 
CM 



cn 

<Mj 



ERIC 



12 



8 

< 



< <-< <\, 
CO CM r-l fH 



< CM CM 

fcrt .* 



S> en cm ^> 

r« CM r-t 



& CX» CM wO 



O uf* O 
C/5 <H 









r-« 






0» 




a* 


(A 














< 






0- 


T? 












U 






&c 


















o 


c 






V 


+j 


V) 




•rf 


«-> 




3 


C 


♦J 




a> 


w 


w 


-a 




*-» 






C 








to 






















SO 


•H 










0 






■M 








< 


to 


T3 










U 






a> 


& 


c 




Uh 












0 


l—t 










<y 




a. 




CP 


CO 




to 








£0 


to 








0) 




0 


t« 


c 


»r-> 




a> 






•a 


fc. 




^ 


0) 


0> 0 


*-* 


^ 


u O 


en 








0) 




< 


CO 


f £0 


« 


• 










CM 


CM 


CM 



CM 



* & 

r-f 



cn cr> 

CM CM CM 



<N fc/> rH 
OO CM r4 



p*» cm o 
I-* f-i * 



0) 

> 

.8 



















CO 






O 














w 


c 








Q 




w 




♦H 


> 


Q) 


a. 






«-» 


a$ 




+-» 








o 


>» 






ft) 


aJ 


B 






CO 




6 




;/> 


<P 




0 









o 
cy> 



CM 



9 

ERIC 



< 






rH Cm 






rH 


o 


»H 






lT» Ml 


on 






r-t 




















C\» rH 


X 


ci 
























t 




>M ^ 






iNi 






rH 






m Oi 






u."> 


r-4 iM 


,-4 <— » 




u:> 


_T 


S 


CO _f 




rH 










— < r-i 


r"i 1 4 


r-4 


rH 


CM 




CN rH 


cv o* 


rH 


rH rH 


















m 




<H */> 












«*> 


-J" r~ 


J" 








jt * 


£N rH 




rH 04 














J- 




o 




r-i O 




m cn 


in 












rH 




CM 


rH r« 






rH rH 




a» 












0> 














• 4 






rH 






rH 




rH 


rH 


rH 


rH 




W 








fl 


0) 


fl 


Oi 


a <y 


fl <y 








f : 


r-i 




f? <-» 




rH 


tl 


rH 


£ rH 


tl rH 










(fl 


4> fl 


a> fl 


V 


fl 


0» 




a» fl 


w> a 




a> fl 












r-4 




u< 


5 











Of 







T1 














>> 










fe5 rH 


rH 








>> 




a» 








0 


*H 












U 




♦H 






a? 


a> 




T? 




<y 


u 


H 




jL. 








a* 








0) 


a> a 












ti a. 










a. 














> U 


c: 




c 


t-. 




a> 


• 








O 


■u 














CI 




t 


rH 






M 


c 




<P 


rJ ^ 


in 






1 


4-» 


0 Q> 




0 








C ^ 


O 




c 


w 










a> 






a> 






rH 


d 


u 


at e 


u 












m 




O 


«^ 


nJ 


•ri ifi 




*H 


o 


•n 






rH 






>s 


cn 


a* a> 
a j2 


a 


£? 




UJ 


a; 




S-i 






■n 






>T1 


rH 




• 






Or 


rH 


C 








rH * 


m 




W) * 










T1 


M 


rH H 




0 


§ 


T) 




rs O 








^* 


0 


U f4 








C£ 
















^* P 1)} 







C 0) 

in itf 

u a* 



1» > 

»H 

x: 

£ u 

* a 



o 



NO 
rH C 
H 
fl 

u a> tu 
•4 e fl 



a a? 
fl x: 



tn a 

? 



fl 

• 

rH 0! 
^ T5 
O fl 
fl U 



o 



w 
u 

u 

o 

-a 

r* 

fl 

2 • 

fl i/y 

r-* C 
rH 0) 

rH b0 

^ n 

U *H 
fl > 



S ^2 
0) U 
U. fl 



0 

4-> 



fl 



a? 



3 

Q 
XI 
fl 

C 

0) 

T? ^ 

*M O 

O 

CJ - 

tn 

t, c 

<v 
\, 

>v 3 

rH t/} 

U (U 
fl 4-» 

*J rH 
«J fl 
O > 
K 01 



fl 

>t 
a 

o 



O 

in 

■H 

cn 
fl 



tn 

01 

-a 
c 

>s C 

rH V 
rH > 
fl »H 

a) 

0 CD 
rH fl 



•» CP 

cv m u> 
rQ +^ 3 

w 

fl 5) W 
rH iH 

o * c 
x: • fl 

CO Qi 

XJ C 
g tn a> 

Cy T3 

E a 3 

15 *' 
Hf Jl 

^ c c 

a cy o 
fl 

iH no 
^ C 

. J *ri 

«t) fl 

cn U • 

in fl ho-M 

fl c 

«H 4-» «4 
O W CD 

<y in 
> <n • 

•H V U 
MOV 0J 

vx: 
*-> 
*o 
in c 

fl o 



fl 



fl 

.c o 

4-> rH 
♦H rH 

*j: fl 



^ U** 00 CT> 



























J* CM 




m 






in * 










u3 r-4 




r-i CTS 






rH 
















r-4 








J no 


^ cr» 




















0) 








01 


rH 








iH 


T» 0* 




0* 






fcl «— * 










0* <0 




rjj rrj 




at at 










tils 


1' 




i 

T? 
















<M 




Sh **•« 














«r«4 * 


01 










to * 


0 


>■* c 






3 • 




to o 




o> 










w > 


TJ * 




o> ^ 




01 0* 


«-4 2ji 


01 


{J 




«—( 




03 








a 




O rH 






a: *** 




01 




^/ fj 


to O 


& 






C 0? 








0) ?4 










|m Oi 


o o 


to 






Of W-t 


4- k 










o tx 




{/) g* 










0) 








c 


^4 T? 






4- 1 


01 


n 














c o 




to 






♦ r4 




r« 

M 








to 


O t5 










*r4 








0» » 


c 




0> *H 


4-> f-4 


C to 






c 




0 4- 


4-» 




0* V 


v> :* 


c 


3 0) 








bo a* 


a a 










at c 




s o 




•H 3 


ki o> 




0^ »c 


e; o ^ 










<T5 to 


rH 




(ft 


G to 


U „ 






>> in 


a> TJ 




l. C 






> u 




O *H 




c 


•H <tf 








&Q 0» 


tiDTJ 


o ^ 


u o> 




CT3 




3 c 






<ti Ti 




fU o 






+j ^ cto 








C to 


to c 


to 05 


at 


b 


♦H 




c*h 


to 


M too 


.c a* 


01 T* 


•H 




C 


^ e 




b0 7 


at o 


♦ |4 C\$ 






O 


h i 























• »> * 









m o 




r-4 


f-4 


r-4 CS 




^ a 




<N CM 














wD O 
















in u3 


o4 


(— t r- * 






r-4 r-4 








cn in 










0 5 


0» 


0> 


Of 


H 




r-i 


rH 


t <u 


o> 


o> 








G r4 




0> <tl 


0) <t5 




o? fd 




U. 








0< 








r-4 




-H 


1 














a* 


t^j 


L» 




TJ 


^, 


0> 


0> 






XI 


T? 








ns 






O'i 


L, 






c 


b0 


T» 




0 




rH 






w-«» 


0 










Ai 






o* 




£ 


to 








0? 






to 


to 






01 




4^ 




to 






0> 




o 


>» 




(0 




L 


o 






s 








to 




>\ 




to 








Q> 




0> 


to 


0 






to 


Q> 






a* 






^ 






Oi 






to 




to 




■H 




01 








T1 


13 


bO 


CO 






c 




t4 


to 




£kD 








C 




>v 


<tf 


0 




r-4 


$H 


B 


O 


3 . 




<fl 










C 






C * 


o 


O to 


O 


o & 




fVt*H 




•rt 0> 




AX 


a to 


<-» 


<* * 






•H (A 


a. > 


T3 


0 ^ 






r~t ^» 




0» (ft 


o o> 




TJ 


a 




o c 




0 GO 




^ TJ 


§§ 


O C 






O 4-» 








w to 


• 


• 


• 


• 



cr> it in 10 



00 


CJ> r-\ 


j» cn 






cv m 


r-4 f-4 


1-4 


tn cm 




cn cm 


a> CD 


cm cn 


jj- cn 


.T cn 


cn cn 




CM f-4 


0 m 




<M CM 


<-4 f-» 


CM r4 


1-4 


<n cn 


r-4 3- 


err Cft 


r* cn 


CM CM 


r-4 r4 


r-4 CM 


cm ra 


CO 


m cd 


JJ- <M 


•n cn 


r-4 




r*4 


rH 


o> 


01 


0* 


Of 


fH 


r-4 


<-4 


rH 


U 0) 


<T5 0) 


rrj 0* 


fff at 


g r4 




6 


B rH 


ot 


o> u 


0> <tf 


0» <t3 










1 

T> 


0> 








01 




c 




L4 




0> 




oo 




T7 


rd 


bD 




o> 




C 




> 


O 


fH 


to 


«r4 


fj 










t> 


ns 


y 


<H 






0> 


c 


Q> 


>> 


*r~> 






rH 


Si 


4V 




0> 


3 




0> 


> 


to 


O 










4y 


4V 








O 


4-1 






0» 






iv 






C • 


fr4 




T5 


0) to 




01 


01 


4h* C 






to 


0 


T5 


3* 


<tJ 


O >r4 


C 


O 


X} 


c 


O • 






to '<-* 


Qt U 




4y 


-r4 O* 


to O 


c 


to 


O 


0) -H 


0 


Q> 




rw O 






♦h to 


E p 




w 


i» 


0 g 


rH 




0? ^ 


O 4-» 




0> 


T> O 


to 


> 






>» C 








r-4-H 


01 


4-* • 




r-4 


.c 


u to 




<TS 0) 




0) 01 


T5 4-» 




TJ 




O « 


to 4-» 


C 


<A n 


0 c 




0) 


OT3 


b0f4 


l«4 


D* 


01 




to O 


0) 


u 0 


m o> 


04 


T5 • 


0) 0 


rC! 


T7 >s 


to 




4J <j 


m 4-* 


to 0) 




0) 




0»'H 


r 


box: 


bOf-4 


TJ T? 




4~» 


t4 


ffl 3 


C 


0'f4 








H * 




0 to 








• 




00 




0 



rH fH CM 



15 



r« CM <TV 



.—4 © CN CT» P* f*> pH 



j oo ^ p* r*» 

CM rH rH rH 



U> r-4 CO O 
«N * rH CM 



CM CV r-t rH 



rH Hp* (V H 



BP r-« 



07 o> r- ^ lo 

rH <-H fV«n 



is cm o 

CM CM CM rH 



J CM 



cm p*. cm cm 
^ ^ «-H HH 



rH rH 



cm cm m oo 



O P* 3" 

CM <V rH 



O <?> O rH <m CM i£ -tf 



rH J? rH CT» 10 
cm m «-H rH 



W N rH C> 
HH cn 



01 0> 

-H #-* 

ITS $ 0* 

Bri £* rH 



4* 



hoi ns o> 



e rH 

«2fi 



r-t 

£3 



4J 

c 

S 

at 
> 

•H 

o 



8 § 



4 



fa 
3 

U 

u 
0) c 

r* 4) 

0 "D 
0 * 

a to 
a 

£-t c 

0*H 



rH 
CM 



if i 
> 

rH 

o 

0 p« 

o 

1/1 (M 

§ w 

U it? 
(A 02 



^ M C 

ai a.> ai 

•H > 
•H 

•H > O 
*r* H 
Ml GO 

u 

o o a 
*t a> 
u 

^ 5S^ 

t*H f 

v a? n 

to 

M rH O 









at 






* 










■y 






< 








a* 


T3 


VI 




CO 


<tl 


01 


in 




U 


r-i 


0) 




GO 




a> 






a 


i/i 
























C 
















•a 


•H 




a. • 






C 




♦j 










to 


*D 








r» 


*h a. 


ft! 


c 

a> 


<P 

a> 




>v 


x> 




w 


ft! 




b0 








C 


a a) 




















0 


O 


D 






0) 


«W >, 








♦J A 




-0 


4) 


«« 




t 


a 


«M -0 


u 








Of 


0) 


c 








«h 


0) a. 








U CV 




O 




a 






















0) 








CO 














tn 








^3 


£ 


o 


^» 


O 






c * 


»n 






ft}*-* 








T>rH 


M 


W rH 




D 4) 


0) 


O O 




♦J 0) 


4-» 


^ O 




« S 




« -C 








r4 O 


tri H 










• 




• 








C0 






04 


cv 



o 

* 

c • 



4y ^ 
a> o 

§ - 

ai a> 

u ^ 
O ^ 

taD$4 

n a 

3R ^ 

O W 

H O 

rH B 

o 

a> 
c <o 



> 





















0) 






4-> 


CO 






o» 


u 


a« 


to 


« 


> 


a* 






4)J 




f» 




p. 


V 




6 


0) 




•r^ 


13 




Xi 






O 


a> 


4>> 



to u* 

If «l 
SS 22 



16 











Ul 




K« 








a 




c 


H 


u 








< 


Ui 


o 








w 
















a. 












AC 






< 








en 




to 






U 


3 






< 








w 












w 






o 







00 



ff» O H u> oncvOO^ O O O O (H O O »*> » tf> (SOOOO 

r-* r-f 1% 4^ <-** 



^jtoo^ L^ii>r»a>a> « ^ r« ,j m o o i£> cr» o*/)t^<n^ 

^ JfVirt J H r< n >\ ri !*1 CM m H l\ W (\ H 



i>*C^(-lr-lr^ CT)C*>f^<^r^ O H f» >n J CO H \£) iH <*» e*> ^ C«* 



uJ £^ O li> C5> («>MOiAtn r** ^ o p* j- o> O M U3 

rs* r-« en «-< r-i j j c\ m «^ ^* cvs m .3* e*> .3" * ^ m 



r-f iM CM i 1 * f\ n r< C\» H rH fS C\ f-4 «-4 r*4 HI 



o ^ u u 



^ 0 $m b In WpfeSUfc* 

U. t0 CO 19 h W^W0 U CO «^ C/5 0 UiC0r>C0C9 ^ co S to <s 



0 ^ fc* U Q U U U 



I 
f 

f 

CQ 
f 

< 

a; 
01 

c 



a 0) 
OS as 

£.5 



c 

t 

t 



% 

Of 

01 

O G 

SI 

c a 



o 

0$ 

St 

a> o 
t? fx 

> h 

a* 

a 

BO 

d U 

O V 
C V 

at us 

(4 0> 

cr a> 
at *-» 

32 

S 

t-t c o 



C 



04 

c 



8 

4-» 



(tl 

at 
c 

<y 

6*0 



4» ^ 
Oh 



5 



2 fe 



9 

ERIC 



J« iH r-f H »\ N H ^ 



(^HOHt? CO <*> <M SJ» 



<• f^^m^r« cr> cm r-* t>« cv ^5 ® cn £2 Of » £ S 
*** * 5 ,h ^ cv * * »n :r * w> *n r* a> w> m ;* cm <n cm 



<d o r*» ^ eft r** p** 

Nmp> 3- & a a 



3 o^r^r-*o» uisou)ui r> H cn o cn ao o 

M rt ^ H c\t ^ <v» C% CM i-t rH <V <^ 



cj>(s n cm n w <o io 

t"4 f-f i-t *H 



Q IN N ^ » ^ 

^ ^ a> ^ 



cn cna co cn ^(*ir»i/fOD ot m « 4- cm 

,-4 f-t ^ rsi HCSH H M r-< CM 

q asitioHH ocvooo 40 ^ o cr> *a <n 



co (N r> u"> h o cv o o «*> 



,c * • 



£j{"3c3 CwWS u, w w o 



£ Q U Q U U U 

vj e> ^w^«o 



1? 



•a 

I 

♦H 

8 

u 

Qi 



I 

> 

o 

<0 



c 
> 

SO 

a 



9 



* • 

in 

V c 

<M tO 

01 c 



#-» 

i 

c 

o> • 

X? ^ 
IH O 

c S 

o 

u- 

to 

d5 0> 
t-i so 

at 

fa <d 

5 Si 



g 



5 

§ 

u 

o> 
*o 
c 

>> c 

r-l > 

to 

M * 



0) 

to 



u 
1 o 
3 * «♦« 

T3 • tO 

3 w co 
O 3 

« o » 

u£ 
o o to 

2 ftf « 

C O 3 
H«o 

CD OF 



0) * 
£ to 



to of bO 0 
<8 CO 

§-S 09 




§ 

CO v 
f0 r-l 
0) Of 
CO 

o (0 

4-* 

o c 

«rt at 

wo 

CQ 4-* 
CO 

u 

o n> 

c 
c o 
a 

*4 CD 

Cur* 

CO 

o o • 
a a co 

5&*S 



9 

ERIC 



13 



< i\ O O 1*1 ja.^J^rv*^ & l>*> r-t 5*OJN<n«3 <*> ^ O H <N( CSi f» r-t a? 



(S f\ M J 



f^l r-f #HI PV* r«< 



^ *3 oq e\» o ;* i**) *^ m <s m^-f^j-^ ^ »\ o p- r<o O uin 

^HrtH J ^ -3" & r+t-iO.iC* tN H (»> i\ H w> J" ^ fN* H 4 1 W 



O a> <j> c*» atf j> ^ r> o ivfvfs con j o J a> q.** a> o> Oinoipo 



r« HHrsi 



dHHH irj n H H 



*3 o> o * job j <*> o o j co o cv <r> *y» t>» <— t c* a> mo HO) 



n^rcn^rm «—* c% r-< «r> :j> cv o cn <\* cm * m 



»3 H ^ O » «N iN O m3 OJlOlJXV r-f CD m <T> -J* O 0> t*- <\ O CP ^ 



^ CN i^t ^ (\ Osl i\ H H 



V« O U fc. W )* O b b M O ^ b b 



SO fit) jC T3 

a* gu • ♦ <8 a) • ♦ <tj 
>o * h q k 



to Ok * • <3 

.£ o t< J* 



UW^WCJ I*tW^WC3 k(/)O(O(0 U» CO ^> CO C? U tO *^ CO CS> 



a* 

g 



C 

o 



a 
a? 

i-f 



0) 



r-* 0) 
itf > 

a> 

a> u 

6 O 

>* u> 
c 

•h d 
m to 

00 00 

c 
V o 



oo 
c 

oo 



c 

3 



00 

c 
o 



o 



§03 

U 5» 



ft) 

-a 

« 

c 

o 
u 



8 



CO 

2 

oc 
o 

§ 



O ft) 

5§ 



I! 



(0 

3 

a 



t 

to 

•S . 

o at 



1 
3 



O 



00 

c 

00 



I 

Id 



t 

O 
V 
»m 

to 
o 

4-> 



•0 



> 



o en 
aoe 

h5 



9 

ERIC 



19 



< *rxr-<*f- ^OJO*H ^<vm^oo UjO<njCV u> <V* « O <*> 



<* o r»> i*** ( ^ pi a ffi fM o o t- r « -4 •-■> « 
J J J ^ J- ^ ^ <%-, <v .<n uT*> l«> (V ^ ^ ^ J kfi ul UJ 



t3 ^,MO«>r^ »MJOr«J CM <T> u> 0^f-^^> ^ fL ^ *° 1 ^ ^ ^ 2 £ 



o^ao p^fnpKoor» cn cn tf> co O f~l O P*. ktf 

Cn M {N <N H H H (V CM <\* O .* 



woow^ j <n p» w n 
^ ^ 



^ Cfl ^1 .'^ OE) <Nl CM & 



[Ti i O H I s " 
H H H 



w >r^r^asii3 cnoOoo op o ^ 

cm f« ^ w cs 



0» ii« ' ♦ t ft 

M O *-» W ^ 

0) w 



4> & • * AS 

Li O U U U 

U- t/} t/) O 



•a 

ft 



ai a* 

(h o w u 



w Xi 



£ O w U 



in ^) O O U.i^*->tOlD 



x: • • 



xt • • 
m * 

ai a, • • 
O k u u 



at 
c 



§ 



o 



XI 

ft 



0) 

a> 
tie 

0 

c 

a 



c • 

v s 

o 

0 »H 

t? o 

ft 

82 

XJ 
wx: 

0 *H 



•H 



-a 
c 

o • 
^ t* 

0 
(ft 



*4 

o 



<8 at 
in ^ 



to 



> 

o 



o 
«^ 

> 

ft? 
tti 

C 

8. 

0) 

■d ♦ 

w 
to 01 



4-» 

c 

S 

> 



«*J O 
O £ 

a. o 
in 
a> 
u 

o 



32 



V* c 



O 4» 

m a? 
a 



o 

c 

O ta 
*h at 



a C * 

4-* 

c 

v a» a> 
<m at 

•OTJ Qt 



c 

O 



> o 

_ o c 
p f ftl 

^ OJ w 

HHQ 



ft 

in 
< 

A ft* 

O at 

o 

ft 

a.v 
at Pt 
a> 
o 
nJ o 

x: 

<m a? 
o 

w +-» 
^* 

c >* 
a> «-» 
a» 

OM 

CO #H 



0 

ERIC 



2U 



< 


«J CJ> 


C*> 




C> H (3D 


cm 


cm 








iM 


<V * » 


<M ^ 




*M 


fH 








< 




^ 5) 








a> 












U* ul 


T 






cm 




*-•» * 






CJ> 


f« »-« 




o 








f«S Q3 i — < 






I-* 












ru 


r- • ' — * 






vM CM 








u.» OD 




u> 


OH«J 


CM 


















CM cm 




« 


CP 






o o o 


CM 


iM 


tn 
















<-< 


«-< 


M 






• 




» 






» 


















• 












& ^ 




tn ^ 








x: 










• > rfl 




♦ 






a. 








^ O 


W« V* V« 


W O 








o 


k w M 








* » i. J u 




•"3 i-'J 15 




i i *r> ivi 





CM <*> CM cn r>4 



<v» ft> m H H 



in & t? 
a • • <o 
o u u 

Ui C"> -3 to to 



<>> i*« h> ao os 
(Nf r-e 



<n r*> cm 

CM CM fr> <*> fr> 



m o p» <n cn 

m ^ CM <m ^ 



(—< CM CM CM r-f 



v a. • • # 
k o u m 

u* w ^-j co u> 



o 
f J 



c 

4) 

5 



V 

o 



3 



0) 
3 



£ 



B 

cn 
-a 

u 



4) 
« 

to 



c 

Ifi 

w 
c 

CP 



4) 

T1 







a x 








c 




w 


til 




















> 






o ^ 






u 






too £ 


*m 
Xi 


c cx 


O 










a 








^! § 




o 




It 




$2 l— < 
























($ ^ 









w 
f 

to 

IT) 
CP 



<M 



CM 



CM 



9 

ERIC 



cv o* 

J- cry r*i 



O C*> AO J 1 
rH «*7 M r-t 



09 C» J ~T O u' f» 
<^ r\* <-« r-4 tM 



<J> H u*» u) * fl* f*» <» 
H (N (% W r-< r-* 



o «*> 39 *— f <*> r-» i/> om 

H H »y -> M i> -J J 



k< O ^ M h 



i> a. * • ra 

W U 14 H ^ 

U« u0 *-> V» C s * 



o 



c 

o 

• H 

m 
n 

o 
u 



1^ i\ m nw 
(N (\ rt rv< 



Uc U. U< U L 



r». od ;* 



m m od ff> 



II H H H M 




to C C <3 *u 
C O a Oi b 
U. « U) 



22 



la 
U 

U 

u 
u 



c 



O 

to 

0> 



4* 



ft! 

cr 

o> 

m 
a 

•r< 

in 
••H 

A 

I 

C .1 
I 

to 
I 

< 



e 
«-* 

in 

ID 

c 

C 





0 












O 










* 




• 


t 






.-f 






tit 




4±> 






-3" 






r ^ 


ID 










• 


* 




* 






































* 


* 


* 


■ 


* 


• 


• 




St 




.9* 








m 






T 














* 






• 


• 


• 


• 






-T 


















O 










* 


* 


* 


• 




* 


• 


• 










it 








I 
































5* 






* 






P 


O 


a* 


U 


ft? 


10 










'H 






to 


> 


• 






XT 




I* 












U 










0 


id 


+ a» 










£Z 




V 


Oi U) 51 




d 




58 


O 










<B 






ns 






ia 


0 


*4 > 
















O 


♦w 


c 


3t 


»ri 












•(-♦ 


O 








c 




p 








JS 


2 *5 








^< 






e 




to 




O* 


s 


0 


ft 








at 0 




5 






je: 


• 


u 


A. 


in 


nS 




u 


u 






















> u 


C 


c 


a* 






•9 c 










> 




* 


U m w 




0 






at 


4-* 




g' w "3 




£ «-* 








C 


@ w 3 










to 




0 












u» 










O 0> 


* 






0 


u> 






Q *■» 


0 V 


c: 


u 


A 








0> to 




a? 


0 


<tf 


O 


3 c n 








r-| 








V Q> 0 


U 


p & 














U 




0 


O 




c 






*C 






O 




& • 


















*c 




tfl 




0 u 








*j 
























n 






£ :i 




« u 












0 


C 


ia <tf tio 






<W 














« £ 


(4 




to 
















ft! 




OOO ■ 




3 O 














8 




a q> 


at 
























a> a> <y 


V • 














> «i ♦ 


•H ZD 




^ 0 




>s 




§ 


•H U 3 


0 • 


•» V 


f> 




-M 






t» O <M 










rH • 










rH C 






9 tn 


O v 


H 


JO 




r-4 5J ■ 


TS k 




a 




















« • 


C Oi G? 


















** 


Of A. 










0 a> 


5 at 


c 


c n su 


tn a? 


O 






3 > 






% 0 0 


0 x 




a> ^ 




*H 




O B 














3i ml 0, (9 






• 


» 


• 


• 


• 


* 


est 


<*• 










CD 





• 



• 

in 



wo 



kT> 



ERIC 



r ■* 










« 


• 


i 




■ 




















M 














* 




















i 


• 




• 




.* 




















* 


* 
















*" ■ 










t 


* 


• 




* 












* 
















•4* 






i < 








t*. 


"*i 






0 


w-4 








U O 


H 






s - 




*H » 






*i 










•C 










•w 










L3 




















o 


& 








u 


*« 0 




>* 






o 




.a 




g 










0 




£ 01 


•a 








<p v« 






1/5 




1k Hi 










0» 












4> 






m 














U 






■ u~ 










0 ^ 




in 






<+* c 


















ft* 




e«t a? 








O 3 


<B > 


4-« 






♦H 


U # 






U 




# *<-* 


*y 




tf) 




c ^ 


T3 




#a tj 


© u 






01 




no * 






•d 


O.C 












a O 


















CV 










•i o 




i 




IM 


* c 


# 






o 


^ V 










o ^ 


c 






c 




<*> a* 






o 


O 


c V 


o 






3 c 












T1 ♦» 
















A* >> 


"if\ ft 






8 








a/ 




u & 


•H O 


g 






4/ O 


a 


w 


*^ X 






O J* 


? s 








w 


'1. t> 


* 








• 













tS2' 




* 




p 




• 


























• 


• 




* 




* 












fall 












J 


* 


* 




* 
















M3 












tV\ 


• 


* 




* 
















«J 


CP 












* 


* 




* 




* 












































Qu 






T3 


U 




>*« 






«H 


•H 




•H 
















u> 








? 




tp 








M 






0» 


<n 




00 




tw 




u 








*C 




IS 




















O 




V 
























o 




u 








.c 




a) 




c 




a. 










til 












0) 












10 


O 




















O 


































M * 


c 


*a 




*C5 








vi 




Q> 




s 




a? 




t/1 




it* 0 


to 


o 








O *H 


in 






^> 




C 


0> 


c 
















l-' 












w 




0 








0) 












4-* 












w 




•> 












c? 




•H 








-o 0 








> 






?s 


« 








k a 








4-» 












U 




u 








0) 




1> « 








•ri 






o 


a 






* 


o c 


1m 




• 


o 




a. 








2 








XI 






*» 0) 




O 


u 












x? 




r> <^ 












O irt 






i 










§ 








X 














w 








• 










* 



• * • 

tS9 m t£t 



4) 

^ *H *H U ** 



c 

0 



4-» 


4-» 


c 


c 








6 


? 




♦J 


> 0> 


ta 


0) u 












u a 












^ 3 


> 


^ 0 




*H U 




*u 


tJ 






rs o* 


VM 








V 






in 


no 


Z£ 








8 § 


n 




0 






>>^ 










•H 


t 0 






'rtf 




0) 




4i 


U 














& 


0) c 
u « 


0) 




* 










to to 


01 *H 




XJ tJ 


XJ 








u c 








• 








SI 



VP 



rr> *** eft 

■ a • 

*r» vo 



<8 Of 

GO 

C +j > 0> 4) 

•r( i/3 0) I* « 

o « 4i 3 s 



O 
01 v. 

o « 

»H 0t 
O W 
to bo 



ai o 4: c c 
u 

a <h 0 94 o> 01 

u u ^ c «> > 

33 «0 • 

1*^ aj o) c ia tio^c: 

«a a t* * ^ ^ a 

lAd 0) otJ oo<8 

n & ♦* P _ v 

a? v> o> 43 13 P >v c 

&x: o» *h v uh v 

t: o »9 ta hh to 



2H, 









Ml 




if 






• 


• 






* 




















CM 









CD 




m 










f-4 


£ 


• 


• 














* 


to 





















a 




9 








J" 


o 






• 




• 


• 


« 


• 








m 








CV 




<*> 


<v 











CM 






CO 




o 


♦ 


• 


* 


« 




• 


• 


• 












CM 




CM 


0* 



• 


<** 






O 






o 




fa 










• 


* 


« 












wo 




ev 







3 

G 



£4 

g 













a> 
















ft 
































o 




£< 


<h 


0) 


■s 


Ui 


0) 


</> 




fa 


fa 






O 


ro 










c 






(A 








2 - 




■H 




















fa 


to 






jC ft) 






■ 






C 




•n a 






in 




>» 






u 














c 


O V 




CO 






& 






c ^ 




o 


(J 


a 


-M 




0i 








»— ( 








a> 












o 








a> 


0) 


c 




«m 


Km 


•H 


a> P. 








fa a* 




o 


rH 








3 




< 




Mm 




a. 


fa 


0) 




CO 




tn 














UJ 




*o 












a 


2 




c 


•n 






at 










fa 








•? 










38 














a» 


2-g 




< 


CQ 






* 






cn 




tr> 








est 





a 



i 



Or ^ 

a> o 
fa ^ 

0 K 

c 

w 

© fsi 

S£ 

O fa 
fa V 

C (X 

O to 
E2 



a* *h 

5 



01 



a* 
> 

O 

O 



0) 
4> 



ft 
fa 



a» 



i 



c 

o 

•H 

2 



o 



9 

ERLC 



20 



c 
3 



0) 
c 
o 
a* 



0> 

s: 

0 

0> 
rH 
♦rt 

o 



< 

00 




0 

ERIC 




DO 






C 




rH 








Xi 












u 




Oj 






t? 






•H 






;i 






C 


4-> 




0 






CJ 


> 










a> 








"0 






0* 




w 


4~» 












01 




0 






TJ 


u 




O 


tft 




>% 












0> 














c 












X3 












4-> 






a\ 










U 


GO 






c 












i 




C 












c 


c 




0 


0 




*H 


•H 






•M 






•H 


* 


a. 


4V 




♦h 




ic 






Co 


> 


An 


• 




« 








rH 







4-> 
















c 






•H 




o 


CJ 




•H 


♦ rH 


*ri 




n 




"f 1 


o> 




a; 




o> 


w 


"V? 


Im 






as 






•o 










ft* 










> 


O 












rH 








c 


u 


4^ 


•H 


re 


a> 


G 




a* 


•r "» 


AS 


crt 




-3 




1) 










a 


yi 


o 


lM 


«-» 










0 


S 


o 


>> 




"H 


u 


r« 








* 




c 










•H 


w 


a> 






& 


tft 




to 


f J 


I? 


o 


in 


V 




» 




c 












•H C 




LI 




o 




•H 












•H C 






w 


•H 








a* 


'Jl 






, TJ 0 






> 




?K 








rH 












a 










0 






•n 




p 


o 


.a * 


o u 






Q t/i 




A* 




ul 


u 








0 t4 


to 3 












2 4-» 




a> ai 


a? 'H 


O 'ft 


a» c 


a 




3-h 


s B 


a* o 


0) 


X 


o ^ 




»-h a> 




M 0 


N H f 
















ao 


<—* 




rH 


rH 



•H 

U 

*H 
C 

o 
a. 

id 

a 
u 



4? 

if) 



0) 
> 
♦H 

u 

0i 



c 

o 

rH 

•H 
> 



rH • 








d O 








3 a 




s 


n* 




0) 


Of 4- 


» -o « 




> tn 


tJ C 


: w a» 




i a> «h 


to 




a 


> f0 3 




: u 4^ 


S 4- 





o 



C 
•H 

4~» 
C 

a; 
fi 

> 

•H 

nj a; 

4-^ 
♦ H 

C 

o 
a* 



o 

£2- 



in 
u 

o 



4-^ 

c 



a> o 



q > 



0) ^ 

o 



o> 



2n»h 

rH 

(0 rC ^* 

' 4-» tH 



0) 

o ^ 

H 4-* 

0) 0 
to 

£ 0i 
0) TJ 



u oj o> 
^ > > 
at 

jC 

o o 



S^.H 



in 



PS* 



0) 
AC 



4) 



0) 

i- 

2 

o 

GO 
•H 

o 
c 

o 

4. & 
3rC 

SI 

-a 

4-» 4-» 

*h a 

a 
w u 
n> 

c 

4^ O 

cn 4-» 



tad 



CM 



2 



0) 
4^ 

nj 

o 

4^ 

c 

0) 
4- 1 
DO 

c 

•H 

4^ 
O 
Q> 

rH 
0) 

C 
*H 



3 

ifi 

4) 



en 



27 



9 

ERIC 



28 



T3 



O 
U 

f 
t 



0> 

Si 



















4 






















00 


H 
* 




CM 


CM 


CM 










W 








rt* 

«o 








t . 

M 








hfl 
uv 








c. 
































uU 








i— ' 








>H 








R 






V 








J> 


£* * 






o 


>u 








<u » 
















CD 4-1 














0 


0) 








£■< ■* -H 


CO 


to 


c 


O 




U 


o 


t*-* V> CD 


to 






0 > 


CP 


£ 




t/) fi'H 


*-> 


ft 


it* 


0> 




0i 


c 


£i u 


& 










g 








h 






to 


01 


o 


u o 


o» 




u 


O CN* 
































































O *M 








r-4 0> 
















O cu 
























-c o 








s 








«X ti 








3 r-4 
















• 
















CM 









9 

ERIC 



30 



c 

3 



*3 



o 



0 



0J 



IT) 



11 



0» 

















< 


\ 




























v\ 




























\ 






















• < ■ 


■- 


















- ^> 




' • 












u> 






& 






U> 










H 






• 


* 








* 












































0) 








& 












0* 




























$j 








rH 




s» 


Of 










0> 


J; 








C 






•H 


0 Of 




0/ 




4> 




X 




** 


T5 


> 






y 






<t5 




f\ 
\j 


& 








M 




^jt 


0) 




g o 


( — { 


tiff 
















ft 




<tJ 


« 






(J0 




^jt 


r* 




V w 




f* 






«H 


•V* 




U 


*H 




rH 




r* 


o? 


OJ 


Tl 


O 


*r4 


t0 


0) 














iO 


C 




s 








fii 

w 


0J 
















Hi 








I— » 














| 








c 




0) 






0> fiS 




•H 




r; 






•> 






> 


■M 






*• 










| 


rH 






c 






CD 


0) 










73 


1 


i 










r\ 
w 


**• 


TJ 




r% 












0? o 


+-* 


0) 










n. 






o 




B 




CV 4) 








•M 


/it 






f3 * 










""<H 




0) 0) 


W 


Q 


0) 


CO 




3 o 








*D 




CO 




o t< 






«H 


10 


rti 
w 


r % 












Ti 

w 


'V M 










trf 


■«€ 

»u 


fti 










>-* 


r, 
>«♦ 






fit 


'W 


V 


*H 


GO 


^> t/} 


0) ^tJ 
















(D 


fH 


(V) 




>s 


^ 0 


<3 c 




iH 








u <y 




0) 


-H 




&0 






QC 




U 


Q> 










>sO 




rH 


a) 


u 


0) 






C 


0 






& 




rH 


a) 






n a) 




rH * 




to 






O M 




3 W 


a » 


a> 


* 


n X 




> 


O V 






a) D 


03 OH 






<TJ C 




a, 


X • 


£- ^ 




H 




a) 




A.J t— 4 


« O 






■o 


: ■ o 


a) 




c u 




O 




« 


X 


C 4^ 


a) x: 






0) -H 


O -H 


H 




+■» 








E 50 




CM 


<*> 











0> 

«fl 

PI 
a) 

x 
a 

*H 
X 

c 

o 



at 
x 



T3 
CO 

U 
0) 

•a 



rH 

3 C 

(A a? 

3 > 



co Jcr> 



u 

k o 

a> 

O • 

rl CI f 

<TJ 0) 0> 
t?[X 

at * ^ 
-n a) 

rH at* 

3 4> 

O O.X 

X 

X O J« 

e ^ o 
at «m 
e * 

>> • o> 

rH^» 0 

U CO CO 
IB'H 

10 

x 

CO C 
C/l 0) «H 
«U p. C 

h a> ; 
> 

>h <y Vh 

V O 

CH C 
rt 0)»«H 
X WO 

m 



3- 

* 



CM 



0) ITS 
6 &♦ • 

to 

ai o o> 

o» to to 

X 

o 



4 X 

(0 



■iH hH 



o 



0 

• C 

a> *h 

o fld 
u u 

g. 

a* 

CO 

a> co 

X<M ^ 

V o 

0> 

ta >>X 

CO < 

a 3 

w 

(a to 

$4 CD 

C <tf c 
-HTf O 

X c 

7 « t4 

. . jH ♦ j ft 
txtz to- 



co 



ERLC 




"1 31 



9 

ERIC 



32 




T3 

G 

• t 

C 

5 

t 



CO 



• 

CM 



ft! 



00 

c 
c 

4-> O 



to 



* (0 
o 

> 

XI 4-» 
CI u 
C 0* 
•n 

b O 
fX * 
V 
b0 V 
C £ 

o «*- 



2 



h5 w- 



■ 



CD 



r-4 



(ft 
01 



9 

tn 

0) 



> 
o 
n 

<* 

o 

n 
o 

c 

o 

o 



9 

ERIC 



33 

THE INSTRUCTOR DATA 

Thirty faculty and thirty associate instructors 
(AI's) were surveyed in this study. The group was 
identified by randomly selecting from current lists of 
faculty and AI's until 30 members of each group had been 
selected. Then the questionnaires were taken to the 
instructors by a research assistant who collected the 
data. 

In light of the frequent controversies which center 
on grades and grading practices, the most striking result 
of the survey of faculty and AI's is the similarity of 
their profiles CFigure 1). If one applies a statistical 
test for differences and uses the .01 level of probability 
for comparing faculty-AI means on each item, only two 
items show faculty-AI differences. On the first item 
AI's are less opposed to dropping the present grading 
system, and on Item 18 AI's indicated that they feel 
that student agreement with the instructor's opinion is 
necessary for a high grade, whereas faculty disagreed 
with this statement. Aside from these two items, the 
first of which merely shows different degrees of atti- 
tude in the same direction, the AI's and faculty profiles 
are so similar that hereafter they will frequently be 
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treated as one group designated instructors. The sepa- 
rate responses for faculty and AI f s are given in Table 1. 

The data provide enough information to answer 
several important questions: Are the instructors favora- 
bly disposed toward the present grading system? What do 
they see as its most favorable or unfavorable aspects? 
What dp they see as the functions and results of grades? 
Do they feel grades are fair to the individual? Why or 
why not? What accounts for high grades? How do the 
instructors feel about instructor options in determining 
grades? The following paragraphs are a discussion of 
instructor opinion concerning these questions. The 
number of the items which support the conclusion pre- 
sented will be placed in parenthesis. 

Overall, instructors appear to believe that some 
sort of grading system is necessary (18). The present 
grading system probably should be retained (1), at least 
until a suitable alternative is deviled. 

Effects of grades . Instructors seem to support the 
belief that grades make students anxious (14), competi- 
tive (13), and more studious (15). An instructor's repu- 
tation as an easy or hard grader influences enrollment 
in his course (11) • Grades affect the student's self- 
concept (24), are useful in selecting students for 
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graduate school (26), and high grades help- secure a good 
job (25). 

Fairness . Under this rubric instructors were asked 
if grades accurately represent differing levels of 
student achievement (2, 12, 6), if the instructors are 
given enough data to make a valid decision (3), and if 
students are properly informed as to the basis on which 
grades are determined (H, 8). Results showed that the 
instructors were undecided as to whether grades accurately 
reflect differing levels of student achievement. However, 
instructors generally felt that they accumulate enough 
evidence to give a valid grade and that the students 
understand the basis for grading. One must therefore 
wonder why grades do not reflect different levels of 
achievement . 

Variables in grade achievement . Instructors see 
grades as being tied to student effort (20), major area 
(21), and the specific section of a multisection course 
in which the student is enrolled. Grades are not a 
function of the instructor's ability (19). The extent 
to which student grades are a function of agreeing with 
the instructor is the only item on which a significant 
(p<.01) difference appeared between the faculty profile 
and the AI profile. Faculty felt student agreement with 
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instructors was not related to grades, while Al's felt 
that agreement with the instructor was related to course 
marks . 

Studying is a relevant part of academic work, and 
faculty endorsed (71 percent) the idea that grades depend 
on effective study methods. However, about a fourth of 
the faculty disagreed with this idea. But faculty tended 
to be uncertain whether grades in one's major courses 
move accurately reflected achievement than grades in 
other courses. 

Instructor options . The instructors felt that they 
should be allowed to select a different basis (paper vs. 
test) and a different standard of quality for grading 
different students in the same class. This means that 
instructors believed that a different yardstick could 
validly be applied to different students. It also implies 
that there is a means of equating, for example, one 
student's performance on a test with another student's 
performance on a term paper. Psychometrically , the 
means for doing this are obscure. 
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COMPARING STUDENT AND FACULTY DATA 

In a smoothly operating system of any kind, all 
groups perceive various aspects of the system in similar 
ways. How similarly do components of the University 
community view the grading system? 

To begin with, students do not believe grades accu- 
rately reflect achievement; faculty agree* However, 
faculty believe that they acquire adequate information 
about a student's achievement* Students disagree with 
this view. Students appear to want more opportunities 
to demonstrate their accomplishments, while faculty feel 
this is unnecessary* One must also speculate why grades 
do not accurately reflect achievement if the faculty has 
collected adequate information on student performance. 

Both students and faculty agree that faculty are 
quite confident about their grades. Students do not 
believe that faculty are too lenient in grading, but 
faculty are undecided on this point. Faculty tend to 
believe that their colleagues will avoid giving D*s and 
F's ev«n for poor performance, while students believe 
that D f s and F's are likely to be awarded in such cases. 
It appears that students see grades as being distributed 
across all marks, while faculty doubt that low grades 
are typically awarded. 
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As to method of grading * Loth faculty and students 
believe that students understand the basis for their 
grades; however, students do not believe that it is 
always clear what it is they are to learn in a course — 
and faculty tend to agree with students on this point. 
It appears that even though course objectives may be 
obscure, the hurdles to a grade are not so unclear. 

Students reported that it is important to agree 
with an instructor, and faculty tended to concur; how- 
ever, AI*s tended to disagree with this contention. 
This may be a clue to various styles of class management 
and amounts of experience in teaching seen among AI f s in 
contrast to regular faculty. It may also mean that 
faculty see themselves as more authoritative than do AI f s. 

Jtudents tended to believe that grades were in some 
degree related to the instructor's ability. Faculty dis- 
agreed. Faculty believed rather strongly that grades are 
related to effective study; students agreed but did not 
feel this way as strongly as did faculty. 

How should grades be prescribed? Students were 
split between objective (test based) grading and subjec- 
tive procedures; faculty were similarly divided. The 
AI's tended to favor an objective base. Both instructors 
and students agreed that a given performance may well 
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be given a different grade in different sections of the 
same course. This, in fact true*, means that a B in one 
section of a course may reflect the achievement of a C 
in another section of the same course. Students and 
faculty agree this is true. Inequities such as this 
probably should be a topic of serious study by departments. 

Both faculty and students agreed (faculty more than 
students) that a faculty member may choose a different 
basis for grading one student than another, but that a 
faculty member should give the same grade to one student 
as another if the quality of the performance is the same. 
Howevsr, significant groups (33 percent of the students, 
26 percent of the instructors) disagreed that a common 
grade should necessarily go with a given level of quality. 
This means that a faculty member can measure performance 
with a different yardstick for each student. In this 
case the meaning of a grade must melt into obscurity. 

Lastly, students and instructors agree that grades 
are related to student competition, that they are anxiety 
producing and that they influence a student's self- 
concept. The personality concommitants of student 
grades seem evident. 

*Doerann, Judith A. H Equivalence of Grades in Multisection 
Courses ". Indiana Studies in Prediction No. 22, Bureau of 
Educational Studies and Testing, Indiana University, 
Bloomington, Indiana, 1973. 



